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Abstract 

A Fokker-Planck equation approach for the treatment of non-Markovian stochastic 
processes is proposed. The approach is based on the introduction of fictitious trajectories 
sharing with the real ones their local structure and initial conditions. Different statistical 
quantities are generated by different construction rules for the trajectories, which coincide 
only in the Markovian case. The merits and limitations of the approach are discussed and 
applications to transport in ratchets and to anomalous diffusion are illustated. 
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Anomalous behaviours in the fluctuations of physical quantities are a common oc- 
curence, typically associated with lack of separation between the macroscopic and the 
fluctuation scale pp . An important example is transport in complex systems such as disor- 
dered media [2] , colloidal suspensions [3| and turbulent flows jl] . If a scale separation were 
present, the system could be described by a local fluctuation-dissipation process, which 
could be expressed as a stochastic differential equation of the standard Langevin type. 
The short-time dynamics of the fluctuating variable, call it Y, would then be characterized 
by normal diffusion, and there would exist local Fokker-Planck and backward Kolmogorov 
equations, describing the dynamics of the transition PDF (probability density function) 



In general, anomalous behaviours could not be accounted for by a stochastic differential 
equation and the non-Markovian nature of the process would be associated with equations 
for the PDF, which are of integro-differential (fractional) form in time j^j. This implies 
that, in general, the evaluation of statistical quantities will require dealing with memory 
kernels in the equation for Y and with the effect of aging [7\. However, as we shall discuss in 
this letter, there are situations in which a description of the PDF dynamics, not requiring 
the use of fractional equations, becomes possible. 

Imagine to evaluate the average at time £2 of some function of Y, given the initial 
condition Y(t ) = Y . Hence, we are going to need the transition PDF p(2|0) (we are going 
to use the shorthand k to indicate the pair Y kl t k ). Suppose we have already evaluated 
p(l|0) for to <t\ = t 2 — At and we want to propagate p( 1 1 0) to p(2|0). Then, the following 
relation holds: 



which, in the case of a Markovian process, for which p(2|l;0) — > p(2|l), turns into a 
standard Chapman-Kolmogorov equation. 

This relation could be generalized to statistical conditions at n 7^ 1 times. In particular, 
the case n = is realized by a standard Chapman-Kolmogorov equation in which the 
propagating kernel is p(2|l). Similarly, it is possible to consider joint PDF's in the form 
p(l|0), 1 = {1, 1', ...}, = {0, 0', ...} and Eq. Q would read: 



p(Y,t\Y ,t ) U 




(1) 




(2) 
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Hence, contrary to the Markov case, generalized Chapman-Kolmogorov equations prop- 
agating PDF's with different conditionings at times t , t' Q ,... involve different transition 
kernels p(2|l; 0). 

A physical interpretation of this multiplicity is obtained observing that an equation like 
(JT|) describes the evolution of fictitious trajectories Y{t) obeying an equation in the form 

Y{t 2 ) = Y{t 1 ) + {AY\l;0)+AW (3) 

with initial condition given by the pair Yq,Yi, t\ — to — > 0. In this equation, AY = 
Y(t 2 \l; 0) —Y(ti) and AW has zero mean and statistics determined, in the At — > limit, 
by (Aiy 2 |l;0). These trajectories are fictitious in the sense that they are not typical 
realizations of the process Y. In fact, in the case of a real trajectory, Yfa) would be 
obtained from Y(t\) using informations on the whole history before t\, and not only at 
t — to or, in the case of Eq. (j2J), at the discrete instants to,t' Q ,... Only in the Markov 
case, cease the trajectories to be fictitious and become typical realizations of the process, 
coincident in form for different n. This in analogy with Eq. which, in the Markov 
case, takes the unique standard Chapman-Kolmogorov form. 

It is possible to introduce a Fokker-Planck formalism to describe the evolution of the 
1-time statistics for the fictitious trajectories and hence of the PDF p(Y,t\Y ,t ). To 
understand the form of the Fokker Planck equation associated with Eq. consider 
the case of a Gaussian stationary process with generic power law scaling at small time 
separations: C(t) = (Y(t)Y(t + t)) ~ o 2 - B\t\ a /2, \t\ < (a 2 /Bf/ a . [This process can be 
turned into a fractional Brownian motion sending a —>■ oo and allowing C(t) = a 2 — B\t\ a /2 
for generic t}. In the case of a Gaussian process, explicit expressions for (AF|1;0) and 
(AW 2 \1;0) can be obtained analytically [S]: 

(A^|i;0) = EL=o^A m v m -F 1 

(AH/ 2 |1; 0) = C 22 - EL=o C2iD lm C m2 

where = (Y(ti)Y(tj)) is the correlation matrix at instants tk, k = 0, 1, 2 and Dij is the 
inverse of its restriction to k — 0, 1: ^2j =0 DijCjk = ^,j =0 CijDjk = 5it- 

In this way we have, for t 2 = ti + dt and t\ = to + t, with t generic: C^k = & 2 , k = 0, 1, 2, 
C m = Cio = C(t), Ci 2 = C 21 — (j 2 — Bdt a /2 and C 02 = C 20 = C(t) + C'(t)dt. Similarly 
for D if D 00 = D n = a 2 $(t) and D 01 = D 10 = -$(t)C(t), where $(t) = [a 4 - C 2 (t)}-\ 
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Substituting into Eq. (JU), we find: 

(oW 2 |l;0) = Bdt a (5) 

and 

(dF|l; 0) = <£>(t){[-a 2 Bdt a /2 - C \t)C '(*)d*]Ki 

+ [fiC(t)dt a /2 + a 2 C'(t)dt]Y } (6) 
Similar calculations could be performed also for (dVl^ 2 1 1) and (dF|l) and the result is: 

(dW 2 \l) = -a 2 Y^ x (dY\l) = Bdt a (7) 

We obtain from Eqs. (|5|fij) the generalized Fokker-Planck equation: 

dt, d tl p + dt?d Yl (Ap) = dt^d 2 Yi (Bp), (8) 

where f3 = min(l,a) is the leading exponent in dt of (dF|l;0), A(l; 0) = (dY/dtf |1; 0) 
plays the role of a generalized drift term and p = p(l|0). 

The presence of time differentials of different order in Eq. (jHj) indicates that this 
equation is degenerate unless a = 1, in which case also (3 = 1. In the subdiffusive case, 
we have (3 = a < 1 and the PDF dynamics is governed by a balance between the drift 
and the diffusion, while the kinetic term dti d^p disappears. In the superdiffusive case 
(3 = 1 < a and the diffusion term disappears. In this case Eq. (jSJ becomes a Liouville 
equation for the deterministic version of Eq. ©: dY/dt\ = A(1;0) and the probablistic 
content of the problem is transferred to the initial distribution for Y\ at t\ — > to- The 
Markov case A(l\ 0) = —BYi/2 is recovered when C(t) = exp(—B\t\/2). The fundamental 
solution p(l|0) oc exp{ — |Yj — Y \ 2 / (2Bt a )} is obtained for t <C B -1 ^ in the three ranges 
a ^ 1 and a = 1 0. 

It is possible to complete the Kolmogorov pair associated with the stochastic process Y, 
deriving a differential equation for the conditioning variable in p(2|0). We consider the 
simpler case in which a = 1 (notice that this does not imply that the process is Markovian). 
Setting t = ti — At, t\ < t 2 , the backward equation can be obtained combining the 
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relation p(2|0) = / dYip(2|l; 0)p(l|0) with p(2|l;0) = p(2; 0|l)/p(0|l) and p(2;0|l) = 
p(0|l;2)p(2|l). The result is: 

p(2|0) = J dYip(2|l)p B (l|0;2) (9) 

where 

p fl (l|0;2) = p(0|l;2)^ffl (10) 

Notice that in the Markov case, pb(1|0;2) = p(l|0) and Eq. (jHJ) takes the standard form 
p(2|0) = f dFip(2|l)p(l|0). Invoking continuity, we can approximate the statistics for AY 
as Gaussian at small time separations; indicating t$ = t\ — dt and ^2 = ^1 + t, we can then 
write: 

'p(0|l; 2) = cexp{-|(dt^ 2 |l; 2)- 1 \dY - (dY\l; 2)| 2 } 
p(0|l) = c' expi-KdW 2 ]!}- 1 ^ - (dF|l)| 2 } (11) 
p(l|0) = c" expi-^dW^Oy^dY + (dF|0)| 2 } 

where dY = Yq — Y\. Explicit expressions for ps can then be obtained substituting into 
Eq. (JTUJ). In the Gaussian case described by Eqn. (JHJ) we would obtain: 

Pb(1|0; 2) = cexp{-|dF - Adt\ 2 / (2Bdt)} 



x{l + B-^Audt + dY 2 d Yo }(A M - A)} (12) 

where 7 = (3 - a and A = A(0; 2) - 2A M (0) with A M dt = (dY\0). Substituting Eq. (O 
into Q and Taylor expanding p(2|l) around Y\ = Y Q , a generalized backward Kolmogorov 
equation could then be written in explicit form (dti = — dt): 

[d tl -Ad Yl + 1 -Bd 2 Yi + S}p(2\l) = (13) 

where S = —[dy 1 + 2Am/B](A — Am)- In the Markov case, the standard form of the back- 
ward Kolmogorov equation is recovered: A coincides with its Markovianized counterpart 
Am, the source term S vanishes and A = —A. 

An application to ratchets 

A simple application of the techniques illustrated so far is the determination of the equilib- 
rium statistical properties of a ratchet field, via the generalized Fokker-Planck equation (|Sjl. 
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Specifically, consider the uniform one-dimensional Gaussian velocity field with correlation 
C(x,t) = (u{0,0)u{x,t)): 

C(x,t) = exp{-^[t 2 + 2Axt + x 2 }}, |A| < 1 (14) 

This velocity field has zero mean both in space and time, nonetheless it leads to a non-zero 
mean flow; in other words, it is a ratchet ^Uj. The drift and noise amplitude experienced 
by a particle in the velocity field u(x,t) is obtained following the same procedure leading 
from Eqs. (jJJ) to (|5I6|) . just neglecting the initial condition at t and defining Cy = 
(u(x(ti) ,ti)u(x(tj) ,tj)) . The result has a form analogous to Eq. ((7j): 

(dW 2 \u) = -2u- l (du\u) = [1 + 2Au + u 2 ]dt 2 (15) 

thus, the stochastic process u(t) is ballistic at short time scales. The equilibrium PDF of a 
particle travelling with velocity u(x(t),t) will obey the generalized Fokker-Planck equation 

d u ((du\u)p) = l -d 2 u {(&W 2 \u)p) (16) 
whose solution, from Eq. (fTo]) is: 

p(u) = c[l + 2Au + u 2 }- 1 exp(-M 2 / 2 ) 

The ratchet mean flow will be given by the first moment of this distribution, plotted in 
Fig. 1. 

An application to anomalous diffusion 

As a second application, we determine the correlation between velocity and coordinate in 
a time and space homogeneous, unbiased, but otherwise generic diffusion process. In this 
case, Y(ti) indicates the coordinate of the walker with Y(to) = Y(0) = 0, and p(l|0) is the 
distribution of the walkers at time t\. We have also: 

(\Y(t 2 ) -r(ti)| 2 > = (5(l;0)|l)At Q = B(l)At a (17) 

with -B(l) = B constant from homogeneity of the process. The velocity averaged at scale 
At is AY/ At; using the definition A(l; 0) = (dY/dtf |1; 0), with (3 = min(l,a) [see Eq. 
(JHJ], we have: 

(YAY/At) = At^(YA) (18) 
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Figure 1: Flow velocity of the ratchet field of Eq. (fHJ) 



We have seen that, in the three regimes a ^ 1 and a = 1, the generalized Fokker-Planck 
equation (jHJ) takes the form: 



Multiplying these equations by appropriate powers of Y(t\) and taking averages, we obtain, 
using Eqs. (1 171 181) : 



which gives a quantitative content to the concepts of persistence and antipersistence in 
generic diffusion processes. 

Further applications of the present Fokker-Planck approach are limited by the fact that 
several operations, natural for Markovian processes, become tricky in the general case. The 
central issue appears to be the multiplicity of drift and diffusion coefficients generated by 
different conditioning choices. 

This has the important consequence that the only physical solutions of equations like 
(jHJ) are those at statistical equilibrium. For instance, if we considered the version of Eq. (jHJ) 



d tlP (l\0) + d Yl [A(l;0)p(l\0)} = 0, a> 1 
^ L p(l|0) + 5 Kl [A(l;0)p(l|0)] = i%[S(l;0)p(l|0)] ) 
A(l;0)p(l|0) = |5y 1 [ J B(l;0)p(l|0)], a < 1 



a = 1 




(19) 
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obtained from the unconstrained moments of Eq. (|7ji. we would obtain an evolution equa- 
tion for the one-time PDF jTTj, which could be solved for an arbitrary, out of equilibrium 
initial condition po(Y). This, however, would produce a Markovianized time dependent 
statistics loosing all the scaling properties of the original process. The right evolution is 
given by: 



In other words, conditioning is necessary to determine the evolution of an out of equilibrium 
one-time PDF. On the same line of reasoning, we find that the evolution described by Eqs. 
(I5J6J8J) (that is conditioned only at one time) is unable to account for the aging of the 
process, which may be defined, including the possibility of non-renewing processes, as the 
approach to equilibrium of the correlation (F(t 2 )Y(ti)|0) as t — > — oo. In this case, taking 
t 2 > h, 



would require evaluation of (Y(t2)|l;0) by means of a version of the generalized Fokker- 
Planck equation (JBJ) conditioned at two times. 

Thus, in general, to determine non- equilibrium statistics conditioned at n times, it is 
necessary to consider a generalized Fokker-Planck equation with moments conditioned at 
n + 1 times. 

These problems limit also the applicability of a Monte Carlo approach based on the 
fictitious trajectories defined in Eq. (J3J. Consider for instance the motion of a particle 
moving with velocity Y. One may try to obtain the displacement statistics by Monte Carlo 
integration of the generalized Langevin equation Q, coupled with the kinematic condition 
on the particle coordinate x(t): dx = Ydt. The first moment of the displacement is 
evaluated correctly: 



Jo 

and (Y(ti)|0) is generated averaging over the trajectories determined by Eq. ©. But, 
suppose we wish to calculate the second moment; we have: 




{Y(t 2 )Y(t 1 )\0) = ((Y(t 2 )\l; 0)Y(t 1 )\Q) 



(20) 




([x(t)-x(0)] 2 ) = 2 fdn [ 2 dMY^Yih)) 



o 



with 



(Y(t 2 )Y(t 1 )) = ((Y(t 2 )\l;0)Y(t 1 )). 



(21) 
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The situation is analogous to Eq. (J2UJ and the conditional average (F(t 2 )|l; 0) is evaluated 
correctly by a Monte Carlo with conditioning at a single time, only in the Markov case, 
when (F(t 2 )|l;0) = (K(* 2 )|l). 

What happens is that x(t) depends on the whole history of Y. To obtain the full x(t) 
statistics, the conditional moments entering Eq. (JHJ should be substituted at time r < t 
by others depending not only on Y{r) and Y(0), but also on x(r), which is equivalent to 
adopting a non-local approach like the one in j^j . (Hence, the result in jH] on the Lagrangian 
correlation time in a uniform Gaussian velocity field, which neglects this conditioning, has 
at most value of estimate). 

Another set of questions relate to the existence of a stochastic process, for a given choice 
of drift and diffusion coefficients, and, conversely, to the uniqueness of the generalized 
Fokker-Planck equation associated to a given process. 

As regards the first question, at least if we want to construct a stationary process, it 
turns out that the choice of drift and diffusion coefficient in Eq. (JJJ) is not free, and the 
functions A(1;0), 5(1; 0) have to be chosen together with the one- and two-time PDF's 
p(l) and p(l|0): it is not enough to impose that A and B depend solely on time differences. 

In fact, from A(1;0) and 5(1; 0), if the process were stationary, it would be possible, 
taking the limit t\— to — > oo in A(l; 0) and -8(1; 0), to calculate the unconditioned moments 
A(l) and -B(l), and, using the unconditioned version of Eq. (jSji . the one-time equilibrium 
PDF p(l). At the same time, knowing A(l) and B(l) would give the form of the transition 
PDF p(l|0) for ti — to — ^ 0, to be used as initial condition for Eq. (JHJ in the calculation 
of p(l|0) at finite time separations. Under these conditions, p(l) and p(l|0) would be 
determined by the pair 1/4(1; 0), B(l; 0)} in the two regimes in which t± — 1 is infinite and 
finite, respectively. It would then be easy to construct profiles of A(l; 0) and B(l; 0), fixed 
A{1) and -B(l), such that the condition p(l) = J p(l|0)p(0)dlo be not satisfied for finite 
t\ — t , which is absurd. 

In conclusion, contrary to the Markov case, to be able to write down a generalized 
Fokker-Planck equation, it would be necessary to know in advance the form of the transition 
PDF that is its solution; a characteristic shared by the approach in [12] ■ The main content 
of an equation like (JHJ seems therefore just to establish a relation, which should be satisfied 
by any experimentally measured stochastic time series, between the transition PDF p(l|0) 
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and the conditional moments (dY|l;0) and (dY 2 |l;0). 

Turning to the uniqueness issue, we observe that the generalized Fokker-Planck equation 
(JHJ), given a transition PDF p(l|0), does not fix by itself the form of the drift and diffusion 
coefficients 4(1; 0) and B(l; 0). In order for that equation to have a probabilistic content, 
it is necessary that the consistency condition 

(g\l) = J dy < ff |l;0>p(0|l) = J dy (#;0) P( ^y 0) (22) 

be satisfied for g = AY, AW 2 . However, this condition, together with Eq. (JHJ) is still not 
sufficient to fix A(l; 0) and B(l; 0). 

To prove this, the following simple example is sufficient. Consider a space and time 
homogeneous, unbiased diffusion process. Again, Y indicates the walker coordinate. From 
space homogeneity, (AW 2 \1;0) and p(0|l) must be function only of Y(ti) — Y(t ) and, 
from the process being unbiased, both functions must be even. Again from the process 
being unbiased, (AY|1; 0) must be an odd function of Y(ti) — Y(t ) and (AY|1) must be 
identically zero. We see then that the definition 

J AY {AW 2 \l; 0)p(0|l) = {AW 2 \l) = BAt a 

is satisfied by the general solution 

(AW 2 \1; 0) = B{1 + c[l - 9 -^L]}At a 

where ^(ljO) = g{Y\ — Y ,ti — t ) is generic and c is chosen so that (AW^IljO) remains 
positive defined. Substituting into the generalized Fokker-Planck equation (jHJ), and solving 
for A(1;0), we see that the result is an odd function of Y(ti) — Y(t ), so that -4(1) = 
(4(1; 0)| 1) remains zero independently of g. 

Thus, uniqueness is not guaranteed in general. However, in order for Eq. (|22|) to be 
satisfied, it is still necessary that the moments of p(2|l; 0) and p(2|l) be of the same order in 
dt. This property is not satisfied by the Fokker-Planck equation derived in assuming 
that, irrespective of a, (dY|l;0) and (dW 72 1 1; 0) be both 0(dt). Like the approach in this 
letter, also the one in ^2] can be seen as a reconstruction technique of the transition PDF 
p(l|0), based on the use of fictitious trajectories. In the case of [T2j, however, not only 
have the trajectories a memory of the past limited to the discrete time to, but, imposing 
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the local Poisson-like behavior dY ~ dt 1 / 2 , they loose also all information on the local 
structure of the real trajectories. This clearly precludes any application of the type leading 
to Eq. (fT9f. 

This work was supported by the Commission of the European Communities under 
contract EVK2-2000-00544 of the Environment and Climate Programme. 
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